FPGA IMPLEMENTATION OF ANN TRAINING USING LEVENBERG AND MARQUARDT ALGORITHMS
نویسندگان
چکیده
منابع مشابه
Improved computation for Levenberg-Marquardt training
The improved computation presented in this paper is aimed to optimize the neural networks learning process using Levenberg-Marquardt (LM) algorithm. Quasi-Hessian matrix and gradient vector are computed directly, without Jacobian matrix multiplication and storage. The memory limitation problem for LM training is solved. Considering the symmetry of quasi-Hessian matrix, only elements in its uppe...
متن کاملModified Levenberg-Marquardt Method for Neural Networks Training
In this paper a modification on Levenberg-Marquardt algorithm for MLP neural network learning is proposed. The proposed algorithm has good convergence. This method reduces the amount of oscillation in learning procedure. An example is given to show usefulness of this method. Finally a simulation verifies the results of proposed method. Keywords—Levenberg-Marquardt, modification, neural network,...
متن کاملTraining recurrent network with block-diagonal approximated Levenberg-Marquardt algorithm
In this paper, we propose the block-diagonal matrix to approximate the Hessian matrix in the Levenberg Mar-quardt method in the training of neural networks. Two weight updating strategies, namely asynchronous and synchronous updating methods were investigated. Asyn-chronous method updates weights of one block at a time while synchronous method updates all weights at the same time. Variations of...
متن کاملNeural Network Hybrid Learning: Genetic Algorithms & Levenberg-Marquardt
The success of an Artificial Neural Network (ANN) strongly depends on its training process. Gradient-based techniques have been satisfactorily used in the ANN training. However, in many cases, these algorithms are very slow and susceptible to the local minimum problem. In our work, we implemented a hybrid learning algorithm that integrates Genetic Algorithms(GAs) and the LevenbergMarquardt(LM) ...
متن کاملHybrid Bat & Levenberg-Marquardt Algorithms for Artificial Neural Networks Learning
The Levenberg-Marquardt (LM) gradient descent algorithm is used extensively for the training of Artificial Neural Networks (ANN) in the literature, despite its limitations, such as susceptibility to the local minima that undermine its robustness. In this paper, a bioinspired algorithm referring to the Bat algorithm was proposed for training the ANN, to deviate from the limitations of the LM. Th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Network World
سال: 2018
ISSN: 1210-0552,2336-4335
DOI: 10.14311/nnw.2018.28.010